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Multiple Random Processes 


10.1.3 Multiple Random Processes 

We often need to study more than one random process. For example, when investing in the stock 
market you consider several different stocks and you are interested in how they are related. In 
particular, you might be interested in finding out whether two stocks are positively or negatively 
correlated. A useful idea in these situations is to look at cross-correlation and cross-covariance 
functions. 

For two random processes [X{t), t £ J} and { Y(t), t E j}: 

- the cross-correlation function R xy (t\, t 2 ), is defined by 

RXY^ 1’ ^2) = 1 )^/ 2 )]’ f° r H’ ^2 J’ 

- the cross-covariance function C X) { 1 1 , t 2 ), is defined by 

Cxfa l’ * 2 ) = Cov(X(t |), F(t 2 )) 

= RXY 1 ’ t?) — 1 7 )' f° r t^,t 2 E J. 

To get an idea about these concepts suppose that X(t) is the price of oil (per gallon) and Y(t) is the 
price of gasoline (per gallon) at time t. Since gasoline is produced from oil, as oil prices increase, 
the gasoline prices tend to increase, too. Thus, we conclude that X(t) and Y(t) should be positively 
correlated (at least for the same t, i.e., C X) (t, t) > 0). 


Example 10.6 

Let A, B, and C be independent normal N( 1, 1) random variables. Let [X{t), t 6 [0, 00 )} be 
defined as 


X{t) = A + Bt, for all t £ [0, °o). 

Also, let (T(t), t £ [0, 00 )} be defined as 

Y(t ) = A + Ct, for all t £ [0, °o). 

Find R xy (t\, t 2 ) and C-^t^ t 2 ), for t x , t 2 £ [0, co). 

• Solution 

° First, note that 
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BxV) = E[X(t)] 

= EA + EB • t 

= 1 + t, for all t £ [0, oo). 

Similarly, 

Hyit) = E[Y{t )] 

= EA+EC ■ t 

= 1 + t, for all t £ [0, oo). 

To find R xy (t\, t 2 ) for t 2 £ [0, oo), we write 

F Xi^ { I’h ) = E[X(t 1 )^ 2 )] 

= E[{A +Bt l )(A + Ct 2 )] 

= E\A 2 + ACt 2 + BAt^ + BCt^t 2 ] 

= E[A 2 ] + E[AC]t 2 + E[BA]t l + E[BC]t x t 2 

= E[A 2 ] + E[A]E[C]t 2 + is[5].E'|M]t 1 + E[B]E[C]t^t 2 , (by independence) 
= 2 + t l + t 2 + t l t 2 . 

To find t 2 ) for t x ,t 2 £ [0, 00 ), we write 

Cxy l’ *2) = i’ ^2) _ 

= (2 + tj + t 2 + 'l^) - 0 + *l)0 + * 2 ) 

= 1 . 


Independent Random Processes: 

We have seen independence for random variables. In particular, remember that random variables 
Xp X 2 ,...,X n are independent if, for all (x l5 x 2 ,..., x n ) £ R", we have 

F X { ,x 2 , . . . ,x( x V x 2’ • • • ’ x n) = FxfiiFxfid- ■ ■ F x( x n y 

Now, note that a random process is a collection of random variables. Thus, we can define the 
concept of independence for random processes, too. In particular, if for two random processes 
X{t) and Y(r), the random variables X(r-) are independent from the random variables Y(t ), we say 

that the two random processes are independent. More precisely, we have the following definition: 
Two random processes {X(t), t £ ../} and { Y(t), t £ J } are said to be independent if, for all 
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h’ t 2’ t m 6 J 

and 

tt t , 

t\> h’ ^ J , 


the set of random variables 




are independent of the set of random variables 

Y(t[),Y(t' 2 ),-,Y(t' n ). 


The above definition implies that for all real numbers x j, x 2 , ,x and y |, y 2 , "‘,y n , we have 


F X( tl ) ,X(t 2 ) , ... ,X(t m ),Y(t[ ),Y(t' 2 ), - ,Y(t' n )( x l’ X 2’ -> x m>yi>y2> n ) 

= F X( t] ) ,X(t 2 ), -. , X(/„,)(* I’ X 2’ ' F Y(t\),Y(t' 2 ), -. 


The above equation might seem complicated; however, in many real-life applications we can 
often argue that two random processes are independent by looking at the problem structure. For 
example, in engineering we can reasonably assume that the thermal noise processes in two 
separate systems are independent. Note that if two random processes X{t) and Y{t) are 
independent, then their covariance function, Cj^/q, t 2 ), for all t\ and t 2 is given by 


F XY^ { 1’ * 2 ) — Cov(X(tj), T(t 2 )) 

= 0 (sinceand Y(t 2 ) are independent). 
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